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apP aratus, and a P-gram recording 

Technical Field ^ _ ^ _ . gnal ooding 

which codes a video signal, a v 
a PP aratus, and a program recording — ■ 

Background Art env i ro nment of a video 

Re cently, digitization of the for 
• „ Por example, appara^u&e 

^ «=-ir.nal involves compression 
of a digital video signal ^ ^ ^ ^ q£ 

signal, and hence there ar.se ^ ^ 

plu ral session ^^JL^ of the 

~ nt-,7 is lowered as a result 
image quality is 1° 

video signal. compression 
3yst ems will he descrihed. - 

oon sidered in which a videc ^ ~ ^ ^ ^ 

the VTR is transmitted oy 



- Afferent from each other in detail 
compression systems are deferent 

■ m order to transform a DVCPRO 
oortion of compression. In order * 

P . a MPEG2 bit stream, therefore, xt 

compressed bit stream to a once 
arv that the DVCPRO compressed bit stream 

" ""HZ -decoded bit — - «~ ^ ^ 

compression. ^ ^ transndssion . 

— -j H^4- stream can oe T.io"= i 
DVCPRO compressed bit srreeu 

bit stream y n , MQ the above-mentioned image 

compression system x. realized, 

^alitydegradationcanbepreventedfromoccurring. Howev , 

terns are different from each other in compression 
the two sys tems are d ^ ^ ^ ^ 

n , flfhnd 0 f VLC code and DC, »Y UUCX ' 

sometimes mcreasea. transformed 

-, ■ -,nf the total code amount of transronns 
that the upper limit of the tor 

bit streams cannot be guaranteed. 

on t h e other hand, « ^lity degradation due to 

■ , .4 anal will be described. In general, 

an image quality is a indiC ates the 

- - — ^ definltl ° LlLgeof afinepattern 

^tisticalpropertyofthe^ ™^ ^ the 

or complex motion, and an image of a ^9 



. • is high m order to improve the image quality 

difference iiaage- performe d on an input 

In the band l^atxon d 

a filter, a filter process is alway 
image by a filter, Therefore, 

^^--^^^-"'TJT^x ^ of 

the re is a * - ' »"e I Lge — * 
a ve ry high * — def i—on, for „ 

gained by P-cessing t h e i^e res-s » ^ 

is sufficiently large. is 

.ontroiledonxvont e^s ^ ^ ^ ^ 

toge . consequently, there P ^ ^ 

_ erectly decide whether a regie 
^possible to correctly ^ on 

tegi on which is visually important or *X9 
which is not visually important. 

coding method which codes a b,t ^ ^ 

so that the code amount of the transformed " 



se t within a predetermined code amount, - an apparatus 
•"^r.-**--— - ntoprovideavideosignal 
coding .P^s in which a «, ^ — - 
used, thereby improving the image luality 

x first invention of the present invents 

n ..„i,a video signal coding method 
(corresponding to claim 1) is a vi ^, crete 

ts o bl e^ai to or smaller than a predetermined code 
amounts to be equa allying N kinds 

tne code amounts being obtained by ^ 
of liable length codings on the discrete cosine transform 

whi le selecting a ^nti.er which, even when any one - the 
syst ems is used, enables the code amount of ,0 ^ - 
I dominant with respect to the code amount in a bit stream 
become a specified code amount. - «- ~ 
attained. 

A second invention of the present invention 

, iB 2liBa video signal coding apparatus 
(corresponding to claim 2 ) is a vi 
characterized in that said apparatus comprises: 



orthogonal transf orming means for performing discrete 

«- ^inital video signal to produce 
cosine transform on an input digital viae 

a transformed signal; 

quantizationesti^ingmeansforselectingaquantizer 

or smaller than a predetermined code amount, - code amounts 
being o bt a in e dby app ly in g < I ua nt i Z a ti o„an dN ,in d so f va rl a bl e 

length c 0d in g s ou the transformed signal; 

quantizing means for quantizing the transformed srgnal 
to produce a quantize, signal, by using sai d quantizer which 
i. selected by sai d quantization estimating means, and 

variable length coding manes for applying one of the 
, Kinds of variable length co d ings which are use. in sa.d 
quantization est^ting means, on the quantize, Signal 

wording to this configuration, quantization can be 
^formed while selecting a quantizer which, even when any 
a anfl hlPS the code amount or Al- 
one of the systems is used, enables toe 

events that are d ominant with respect to the code amount 

reified code amount, and tne 
in a bit stream, to become a speortiea 

objects can be attained 

K third invention of the present invention 
(co rrespon d ing to claim 3, is a vi d eo signal co d ing apparatus 
according to the 2 n d invention of the present invent^ 
ch aracterizedinthat the input digital video signal rsav^o 

slgn al which is previously divided into predetermined coding 
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units, and 



, and 

said.uantiza.iones^atin^eans selects a .uantizer 

for each of the coding units. 

of ^-he present invention 
A fourth invention of tne pt« 

i a\ is a video signal coding method 
I corresponding to claim 4) is a vi 

o a second bit stream by using decoding of the 
Xength coding, difference predictive coding, an. second 
variable length coding, characterized in that 

in the Ration, guantization is performed while 
^lectin, a guantizer which enables both code amounts that 
se ng , . ^iirrt and second variable length 

are obtained by applying the first and 

^ * 4-h= discrete cosine transformed 
codings on AC components of the discret 

input digital video signal, to be egual to or smaller than 
a if ferential code amount that is obtained by subtracting 

rl a predetermined code a—, a — « code amount 
:i is a larger one among a predictive code amount which 
^1 f f erence predictive coding on DC 
is obtained by performing difference p 

components of the discrete cosine transformed 

vidl signal, and a fixed cCe amount in the case where the 

OC components are set to a fixed length. 

K fifth invention of the present invention 

! ™ ^ is a video signal coding method 
(corresponding to claim 5) is a vi 
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• tdiaitalvideosignaliscodedbyusingdiscrete 
cosine transform, dxfferenc „„ ce a first bit stream 

-«««— -^ M ::dU«^ 

transformed to a secondbit streai 
^-ding, and second variable length coding, 

Chara l r r Jan^ion, Ration is .rformed^ 
ntizer which enables both code amounts that 
selecting a ^ant^er wh ^ ^ 

are obtained b y appl^ th ^ 

codings on A C components o t -~ ^ ^ ^ _ 
inpu t digital video s.gnal, to be « 

. differential code amount that - b^ T ^ 
f rom a predetermined code amount, m~ ^ 
wh ich is a larger one coding on ,C 

- ° btained ::;"or e - — — 

components of ^ ^ ^ ^ _ where the 

video signal, and a nxe 

BC components are set to a fixed length. 

A sixth invention of the present invents 
(C o— t ocla. 6) isavide 0 signal c^g apparatus 

cha racteri,ed in that ^^^^^ 
orthogonal transfo^-- ^ ^ 

cosine transform on an rnputd.g.talv 
a transformed signal; 



. B (H>2l o£ code amounts to be eq 

by applying quantization 

-« of the transformed signal; 

- " — 12 «« »• - — — " 

- - ,^hle length codings which are us 
* kinds of variable leng ^i.ed signal. 

s-al codings 

characterized m that saxd ^ discrete 

orthogonal ^ ^ signal to produce 

cosine transform on an input digxtalv 



I difference predictive code amount, and a f «* code 
among the differenc e are set to a fixed 

amount in the case where the DC cedents are 
length, as a OC estimated code amount; _ 
o.antisationestimatingmeans for select^ qu 

. • a , N > 2) of code amounts to be equal to 

■ DC estimated code amount from a 

by subtracting the DC estima ^ ained 
the code amounts being obtaxned 

sa Id guant^r which is selected hv said quanta 

estimating means; and app w in g one of the 

variable length coding manes for apply 
. Kinds of variable length codings which are used m a.d 

— — ° n the ^ ti2e ::; 

. <-^n of the present invention 
A eighth invention of tne p 
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code amount which _ 

in the case where the DC components 

= nr estimated code amount; 
^ ^on.t.ans^means^pe— ^ 

oosine transform on the digital video signal for each of 

bl oc*s to produce a transform coding unit, 

^ntizationestimatin.means.orselectxn.a^ant^ 

rluer than a differential code amount which is ohtamed 

- • nr estimated code amount from a 

by sub tracting the est ^ 

^determined code length codlngs 

by applying quantization andN kinds ot 

4-= nf the transformed signal; 
on A C componen « ^ ^ ^ o£ 

quantizing means tor q 
th e transformed signal to produce a quantized signal , * using 
;Hd \uantizer which is selected, said guanti^on 
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-rr:: ———>•- 7-- 

quantization estimating means, on q 

x ninth invention of the present invention 

♦ lai* 9) is a video signal coding apparatus 
(corresponding to clam 9) a rharac teri Z ed 

» of the 6th to 8th inventions , character! 
accordingtoan y oneo - 

in t:ils" - predetermined coding units, and 
" P Stantizationesti^ting^ns 

for each of the coding units. 

X tenth invention of the present invention 

,-!» 101 is a video signal coding apparatus 
(correspondingtocla^lO) e(J in that the 

„ the 9th invention, characterxz 

:i— := .err— 

==4-imated code amount. 

estmated invention 

^ C a video signal coding method 
inwhichaninputdigitalv 

coding, and first transformed to a second bit 

a first bit stream that can ^ 
stream by using decoding of the first 



information, .Woo""'- » »" „_ vhtl . 

amount which is a xary 

first and second additional information. 

nf the present invention 

* twelfth invention of tne p*. 

, i^.isavideosignalcodingapparatus 
( corresponding to clarm 12 ) rs a v 

oha racteri,ed in - ^ diso rete 

— 1 — ^ J o signal to prod nce 
cosine transform on an mput drg.tal 

• 1 tionai information amonnt is a larger one 
amaXUnUma t Qf first additional information that rs 
„ a code — ^ ; s f t ^ streamwhlchisob t a ined by applving 

^ - - — * Si9na1 ' ^ 
£irst varr^e - ^ ^ ^ ^ ±s to be 

. code amount of seco ^ . ng 

attach to a second stream gignal; 
second variable length coding on tne 
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« o fnr selecting a quantizer 
^izationestimatingmeans for sexe 

t h a code amount that i- opined * 

— atl ° n ^ T Z code a— - ~— * 

transformed signal. • ^ coding 

applying ^ - to or snaller than . 

on the transf ormed sign ,~ > ^ ^ ^ racting ^ 
differential code amount that predete rmined 
^imum additions information amount from 

code amount; ing the tra nsformed signal 

o.antizmg means , ^ ^ 

18 S " l^odin g ^e Sf ora PP i y i ngth e fr or 

• b le length coding on the quantized signal, 
second variable length .^.^ 
A thirteenth invention of the pre 

n m 13, is a video signal coding apparatus 
(corresponding to cla>m 13, a ^ the 

_ 12th invention, characters 

according to the 
iaputdigitalvideosignalisavi 

d ivided -into predetermined coding ^^cts a quantizer 
saidquantizationestimatingmeans selects 

A fourteenth invention of the pre 

, •„ 14, is a video signal codxng apparatus 
(c orrespondingtoclaxmU> is a ^ ^ the 

the 13th invention, character 
according to the an average 

differential code amount is a difference 
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«- which is obtained by dividing 

— Trrr— 

coding and f trans£o rmed to a second bxt 

a first bit stream that - iengfch ooding , 

stre amby using decoding of the 

•„hla length ooding, and adding tne 
and second variable lengt additio nal 
ad ditional information with change to 

— char rin: - e 

meeting a guant^ « ^ ^ 

are obtained by applV^ ^ ^ 

co dings on *C co^nent o » e ^ _ ^ _ & 

dlg ital video s.gnal, ' ^ » 

differential code amount that . ditional information 

f irs t and second add^o ^ ^ ^ 

— * — ^ a lar96r : if f Ice predictive coding on « 
is obtained by performing d^fferen 



- 14 - 



ts of the discrete cosine transformed input digital 
components of the ai 

• i «nd a fixed code amount m the case wnere 
video signal, and a nxeu 

4.= ar-* set to a fixed length. 
DC components are set: 

f i-u^ oresent invention 
A sixteenth invention of the prese 

<= discrete cosine transformed 
codings on AC components of the dxscret 

i to be equal to or smaller than a 
digital video signal, to be equ tracting , from 

differential code amount that is obtainedby subtracting, 

lunt which is a larger one of information amount - «- 
f irst and second additional information , and a »»— DC code 
h ch is a larger one among a predictive code amount 
amount which is a large ^,^ tve coding 

wh ich is obtained by performing difference pred.ct.ve 
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- <_ he discrete cosine transformed input 
on DC components of the discre vhecase where 

n a nrf a fixed code amount in the case wnere 
digital video signal, and a f xxea 

arP set to a fixed length. 
the DC components are ^ 
A seventeenth invention of the presen 

i - m i7U S a video signal coding apparatus 
(corresponding to claim 17 ) is a vx 

. • 4.H«t said apparatus comprises. 

„„. „„..«. - - — «— * - - 

a transformed signal; 

code amount estimating means for settxng 1 
£ a .if f erence predictive code amount wnicn is obtained by 
TIf f Ince predictive coding on OC components of 
performing dxfferenc H , aital video signal, 

- — — -rr-t * . 

„nd a fixed code amount in the case wne 

and a fixea estim ated code amount; 

+n a fixed length, as a DC estima 

" — — — — - — t 

. code amount of second ^ 

se cond variable length coding * ^ 
^ationestimatxngme - ^ 

which enables both a code amount that 
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, first variable length coding on AC 
quantization and the first 

of the transformed signal, ana 
counts - - ^ ^ ^ ^ varlable 

is obtained byap j; Qf the transforme d signal, 

length coding on the AC c P e ^ that 

to be ^ - - ^ lerth retc eslated code — - 
the maximum additioua 

Tsignal to produce a quantized signal, by using 

estimating means ; and aDO i yi ng the first or 

variable length coding manes for applyi g 

d variable length coding on the quantized signal, 
second variable i resent invention 

M eighteenth invention of the presen 
(cor re S .ndingtocla 3 ,13 ) isavideo S ignalcod.gapparatns 

characterized in that ^^^^^ 
orthogonal ^ signal to produce 

cosine transform on an input digital 

a transformed signal, ^ ing difference 

predictive coding -ans for P ^ 
• ^i„o on DC components of the ais 
predictive coding on o obta ining a 

transformed input digital video signal, 

di££ erence predictive code amount, ^ 
code amount estimating means for setting 
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. nredictive code amount, and a fixed code 
of the difference predict! 

amount in the case where the OC components are 
* DC estimated code amount; 

■ dditionai information amount which is a larger one 
a „add ltl onai ^ ^ ^ 

- ' ^ ^ £ s r t stre^whichiso b tained b vappX y in g 
be attached to a first b.t transformed signal, and 

f ira t variable length coding on the transf 

, of second additional information that xs 
. cod e amount of seco ^ ^ 

cached to a . c -t ^ ^ ^ 

T both a code amount that is obtained by apply-* 

^^rift transformed signal, and a code amount that 
components of the x.x variable 
is rained by applyi. ^on ~ ^ ^ ^ 
leng th coding on the A C -"^^ ^ that 
to be egual to or — code _nt and the 
is obtained by subtracting DC predete rmined 
-iti-1 information amount from P 

COde — for .anting « — 

said quantizer which is selected y 
estimating means; and 
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variable length coding — toe aPP^ «- ^ 
second variable length coding on the quantized signal 

A nineteenth invent of the P-sent mvent.on 
( correspondingtoclaiml 9 > 

characterised in that said apparatus comprises: 

code amount esti^ting — * fOT ' f » "° h , 
• „ blocks of an input digital video signal, 

zr.— -- — —- — 7. 

in the case where the DC components are 

» nr estimated code amount; 
^ 3 orthogonal transforming mean, for performing discrete 
oosi ne transform on the digital video signal for each of 
bl oc*s to produce a transform coding un.t; 

actional information estimating means for detect, g 

H hit stream which is obtained by 
to be attached to a second bit stream 
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— — — —-7 

components or lsmtiza tion and the second 

t hat is opined by apply-* — q£ ^ trans£orm 

^r, the AC components 01 
— C ° din9 7 M ^ller than a differential 

coding unit, to be equal to sma 

^ that is obtained by subtracts the DC 
code amount that nal in£orm ation amount from 

code amount and the maxuaum addition 

a ^edeterm ^ ^^anti^ the A C components of 

- ant " in9 ^ ±t to produ ce a quantized signal, by 

— — ^ h ^r:;:;:r::r- 

A twentiet h —;;- f ;i: ignal coding^ 

Responding to cla, 0 - ^ 

according to any one of wl video signal is a video 



units, and 
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for each of the coding units. 

Hnnof the present invention 
The twenty-first invention of P 

n ira2 l)isa video signal coding apparatus 

difference predictive co ^-determined 
. . lf erence obtained by subtracting, from the predete 

1 the OC estimated code amount for a bloc* in the 
code amount, the OC ^ ^ 

^ZZZ^ - — additional 

ir^rruntb;an™berofthecodin g unit S intheinput 

digital video signal- .^.^ 
A twenty-second invention of the p 

, . mi9a video signal coding method 
.corresponding to claim 22, « v ^ 
^r,i + al video signal is cowu * 

:r.:r:": — « 

+. in i-he case where tne 
a second system code amount m the 

cosine transformed and quantized previously - time 
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diso rete cosine transformed ^ *~ — Wh±0h 

is the object of the quantization 

is compared W ith a preset ideal code amount of the 

h the ideal code amount, a quantizer which performs coding 
than the ideal co previo usly determined 

at a first target code amount that is prev 
• first system is selected, and 

" II the second system code amount is larger than «. 

cosine transform, difference p 

, first variable length coding to produce a f bit 

in i-he case where tne 
a second system code amount xn the cas 

^ ^ second variable length 
,. flHvp coding and the secono. vo. 



- 22 - 



cosine transformed, difference predictive coded, and 
^tised Preview in time to a discrete cosine transformed 
input digital video signal which is the object of the 

^TlUparedwithapreset ideal code amount of the second 
system, and 

w „entheseconds y stemcodeamountisegualtoorsmaller 
tha n the ideal code amount, a suantiser which Performs codin, 
at a first target code amount that is previously determined 
in the first system is selected, and 

id eal code ^ount . a .uantizer which performs coding at a code 

^^twenty-fourth invention of the present invention 
corresponding to claim M , is a video signal coding method 
according to the 22 nd or 2 3rd invention, charactered in that 
th e ideal code amount is stepwise increased by a substantially 
constant" value with the passage of time. 

X twenty-fifth invention of the present invents 

, ,^ is a video signal coding method 
(corresponding to claim 25) is a vx 

wording to any one of the ^d to 24th inventions. 
cha racteri Z ed in that, when the second system code amount is 
a ger than the ideal code amount, a cuantiser which Performs 
co lg at a code amount that is obtained by subtracting a 
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rf «vstem code a»»t and the ideal 
difference between the second system co 

, the first target code amount is selected. 

9 invention 
A twenty-sixth invention of the P 

i „ 26> is a video signal coding method 
corresponding to -~ ^ 25th 

wording to any - ^ gignal which is 

means a predetermined partia g which 
discrete cosine transformed input digital video 
■ ,h. nbiect of the quantization. 

15 the ° bDS +- rt „ of the present invention 

fiESt variable length coding, to produce a 

first varia strea m which is coded 

th at can be transformed to a second bit stre 

bv a second system by using decoding of the first 

r e ;gt:coding, Terence predictive coding and second 
triable length coding, characterized in that 

said apparatus comprises: riiacrete 
ort hogonal transforming means for performing discrete 

a "C^^ for^ingthetransformedsignal 
to produce a quantized signal; 
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a dif ference pre d ictive co d e amount in the case where 
di f ference predictive coding is performed on OC « - 
of . digital video signal which is discrete cosine transformed 
1 u Li- P— y in time - the 
L h is the oh,ect of the nation in said guant^ng 



means 



second-system code amount estimating — 
estimating a second system code amount which is . «** - 
e difference predictive code amount, and a code amount. 
I case where the second variable length coding is per* ormed 
ts of the digital video signal which is discrete 
on AC components of the aigx 

COS ine transformed and guantised previously xn txme, 

^nti.ationest^ting.eansforccaringthesecond 

^code^ntwithapresetidealcode^ntofthesecoa 

smaller than the ideal code amount, selecting a guan^ 
whi ch performs coding at a first target code 

j . . h _ fH rst system, and, when the secona 
previously determined xn the first syst 

. larger than the ideal code amount, 
system code amount xs larger 
selecting a quantizer which performs codxng 
tha t is smaller than the first target code amoun t ^ and 

variable length coding means for applying the 
var xable length coding on the ^ti.ed signal, and -re. 

„ an H,e fl AC components of tne 
said quantizing means quantizes AC 
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by using said quantizer which ,-Sselec 

na thereby producing the quantized signal, 
estimating means, thereby P inven tion 
A twenty-eighth invents of the presen 

and first variable length ooding to produce a first bit str 
and first va u decoding 

characterized in that 

said apparatus comprises: ,<, erete 
orthogonal transforming means for P~f orm,ng discrete 
c osine transform on the input digital video signal to produce 

* • <-h e case where the difference predictive 
* nr rode amount in the case wucj. 

a DC cooe cuu „ii-al video signal 

coding is ^formed on »C components of a d^ta 

whi0 h is discrete cosine — 
cooed, and quantized previously in t- the tra 

signal which is the ob.ect of the quantization in 
quantizing means; 
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second-system code -cent estimating means for 
estimating a second system code amount which is a totaX o 
the dc code amount, and a code amount *» *- case where the 
second variable length coding is performed on AC components 
of the digital video signal which is discrete cosine 
wormed. difference predictive coded, and guanoed 

PreVi0 r— est^tingmeans f orco.arin g the second 
^temcodeamountwithapreset ideal codeamonnto, the second 

I smaller than the ideal code amount, selecting a ^ 
wh ich performs coding at a first target code amount that is 
. ,-h» first system, and, when the second 

previously determined in the first syst 

lecting a quantizer which performs coding at a code amount 
that is seller than the first target co,e 

variable length coding means for applying the 
liable length coding on the quantised signal, and where. 

said quantizing means quantizes AC components of 
transformed signal which is an object of the quantization 
by usingsaidquantizerwhichis selected, saidquanti^on 

estimating means, thereby producing the quantized signal- 

A twenty-ninth invention of the present invention 
corresponding to claim ,3 , is a video signal coding apparatus 
cccrding to the 2 ,th or 2 8th invention, characterized in 
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the ideal code amount is stepwise increased *y a substantially 
constant value with the passage of time. 

of the present invention 
A thirtieth invention of the pre 

-. . , 0lisa video signal coding apparatus 
(corresponding to claim 30) is a viae 

acco^, to any one of the 27th to 2 9 th inventions, 
cha racterized in that, when the second syste, — — * - 
i^erthantheidealcode-ount, said quantization est^trng 
.eansseiectsa.uanti.e.w.ic.pe^sco^atacodea.ount 

^ <-v,o ideal code amount from the first 
system code amount and the ideal 

target code amount. 

A thirty-first invention of the present invention 

_ i 311 is a video signal coding apparatus 
(corresponding to claim 31) is a via 

according to any one of the 27th to 30th inventions 
characterized in that the digital video signal wh.cn x. 
iLete cosine transfer^ and quantized previously - *~ 

• * r«r+ial signal which is previous to the 
means a predetermined partial signa 

Lcretl cosine transformed input digital video signal wh.ch 

is the object of the quantization. 

A thirty-second invention of the present mvent.on 

^responding to clai* », is a video signal coding^ 
Lwhichaninputdigitalvideosignaliscoded.yus.ng^e 

co sine transform, quantization, and first variable length 
ding, and first additional infection is added to produce 
a first bit strea* that can be transform to a second 
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, • of the first variable length coding , 
stream by using decoding of the 

,. nn an d second variable lengtn 
difference predictive coding, and se 

d „. , he firs t additional information with 

— - 

uantizer which enables both code amounts that 
selects a quantizer ^ 

« obtained by applying - *~ * 

codings on ,C --^ al to or smaller than a 
^„ iM i video signal, to be equaj- 

digital via „ htaine d by subtracting, from 

differential code amount that is obtained by 
a predetermined code amount, a larger one among a first tota 
h ich a fixed code amount in the case where DC components 

l settoa f ix ed length is added to -~J^ 

* vhP first additional information, and a secon 

I LTa Lence predictive code amount which is obtained 

• difference predictive coding on DC components 
by performing difference P 

of the discrete cosine transformed input digital 9 
of the discre second additional 

is added to an information amount of 

information. OTes ent invention 

* thirty-third invention of the present 

, • vn is a video signal coding method 
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nd first va.ia.le length coding, and first actional 
and first va ^ ^ can 

infection is added to produce a ««* ^ 
be transformed to a second b it stream by us-g 

the first variable length coding, decoding of the d.f 

,• and second variable length coding, and 

predictive coding, and secon 

aaaingthefirstadditionalinfor.at.onwxthchang.ng 
addi tional infection, — ^ f while 

are ob tainedb y ^ ^ 
oodi ngs on *C >™^ «* „ or sraaller than a 

di gital video s.gnal, to * e, subtEacting , £r om 

dif f erential code amount that „ obtained y 

• a^a to an information amount of the lira 

" 1 a second total in which a fixed code amount 

.nfo^on »d ^c of ^ ^ oQsine 

in the case where DC c P nalaresetto a fixed length 

^sfor^dinputdigitalv.deos.gnal^s ^ 

i. added to an information amount of 
^^rty-^ 

to clal 3. Ivideo signal coding apparatus character^ 
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• *h»t said apparatus comprises: 

xn that said PP perfo rming discrete 

orthogonal transforming means for p 

. ♦ dioital video signal to produce 
cosine transform on an input digital v 

a transformed signal; 

of a fixed code amount in the case where DC components of the 
transformed signal are set ^ ^ g 

of first additional information that is 

le ngth coding on the trans ^ ^ 
second detecting means for detecting 
, faaifferencepredictivecodeamountwhichisobtaxned 

— — — r:rrr 

of the transformed signal, and a code amount of second 
of the attaohed tQ a second blt 

- „<- that is obtained by applying 

which enables both a code amount that 

- <-h e first variable length coding on AC 
^antization and the first 

components of the transformed signal, and 

i. obtained by applying Ration and the second 

,■ on the AC components of the transformed signal, 
leng th -- - -- ^ ^ f code that 

to be equal to or smanex 

i8 obtained by subtracting a larger one among the 
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„t and the second tot-. — • predetermined code 

amount ; . nf 

q uantizing ***** f « ^ *= COraP ° nentS 

th e transformed signal to produce a guantized signal , by using 
said guantizer which is seated by said o^antization 
estimating means; and 

variable length coding manes for applying the xrrst 
se cond variable length coding on the guantized signal- 

A thirty-fifth invention of the present invention 
corresponding to d-J- 3S , is a video signal coding apparatus 
characterized in that said apparatus copses: 

orthogonal transforming means for performing discrete 

4- Hi nital video signal to produce 
cosine transform on an input digital via 

a transformed signal; 

pr edictive coding means for performing difference 
pr edictive coding on DC components of the discrete cosine 
transformed input digital video signal, and obtain^ a 
difference predictive code amount; 

of the difference predictive code amount, and a code amount 
of fir st additional information that is to be attached t a 
firs t bit stream which is obtained by applying first variable 

le ngth coding on the transformed signal ^ 
second detecting means for detecting 

„t of a fixed code amount in the case where OC components 
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• \ „™> set to a fixed length, and a 

„ that is obtained by applying 

which enables both a code amount that 

„ the first variable length coding on AC 

components of the tranced signal,^ d 
is obtained by applying quantization » ^ 
le ngth coding on the AC components of the transf 
to : equal to or smaller than a differential c.e amo^ - 
• « obtained by subtracting a larger one among the first 

r:r :: z — — - * °° de 

^antizing means for quantizing the AC components - 
th e transformedsignal to produce a quantized signal .sing 
S aid quantizer Wh ic* is selected by said quantization 
estimating means; and 

variable length coding manes for applying the first 

wh ich. even when any one of the - _ ^ 

the specified code amount is selected. As 

a bi t stream which is compressed by using the presen 
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i. transformed into another cession system by us.ng only 
bit stream transformation, it is possible to guarantee that 
the rate of the transfon.ee bit stream can be set w.thm a 
predetermined rate. Xn addition to V.CS, a ^antizer ,s 
selected while estimating difference coding of DC components 
ha ving a possibility of changing the rate of a bit stream 
a nd the rate difference due to difference in synta*, whereby 
the accuracy can be further improved. 

A thirty-sixth invention of the present invention 

, < m ifil is a video signal coding apparatus 
(corresponding to claim 36) isaviae 

characterized in that said apparatus comprises , 

m otion vector detecting means for. for an input ^ge, 

meeting a motion vector with respect to a predetermined 

reference image; 

dif ference image producing means for, for the rnput 
^ ge , producing a first difference i^ge with respect to the 

reference image; 

filter coefficient determining means for calculate 
visual stance of the input i^ge on the basis of the input 
^ge .nd the first difference i^ge, and determine a f .Iter 
coefficient for performing a filter process on the input .mage, 
fiXter processing means for performing a filter process 
on the input image by using the filter coefficient , to produce 

a filter image; 

m otion compensating means for performing motron 
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the filter image by using the motion vector, 
compensation on the filter im 

■™ of lower visual importance, to reduce 

— d ° n VTotl a -ger code amount can - locate, 
the code amount, so that awy 

" a region of higher visual importance, ana the >ma g e quality 

can be improved. 

A thirty-seventh of the present invention 

laim37> is a video signal coding apparatus 
(correspondingtocla^, is d in that said 

wording to the 36th invents. 

efficient determining means calculates v 
filter coeff icient activity of 

„f che input image on the basis o 
importance of the inp diffe rence image, 

the input i^ge and an activity of the first 
^ ermines the filter coefficient 

. th irty-eighth invention of the pre 

laim 38, is a video signal coding apparatus 
(corresponding to claim ^ ^ invention , characterized in 
according to the 36th or the 37 

. »id filter coefficient determining means 
that said filter c process, from 

mter coefficient for performing the filter 

„f filter coefficient candidates, 
a plurality of filter inven tion 
A thirty-ninth invention of the presen 

,• tocla^, is a video signal coding apparatus 
(corresponding to claim j») 

charactered in that said apparatus comprises. 
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mo tion vector detecting means for, for an input image, 
det ectin g a motion vector 1th respect to a preened 

reference image; 

difference image producing means for, for the -put 
M . producing a first difference image with respect to the 

reference image; 

first filter processing means for performing a first 
f iiter process on the input image to produce a first filter 
image ; 

filter parameter determining means for calculating 
visual importance of the input image on the basis of the input 
i^ge and the first difference image, and determining a filter 
parameter for performing a second filter process on the mput 
image and the first filter image; 

second filter processing means for performing a second 
f iiter process on the input image and the first filter image 

^tion compensating means for performing motion 

vector, to produce a second difference image; and 

coding means for performing coding on the second 
difference image to produce a coded data. 

wording to this configuration also, a filter process 
is conducted on a region of lower visual importance, to reduce 
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to a region of higher visual importance, and the — guality 
can be improved. 

4.-„„ n£ the present invention 
A fortieth invention of tne pt 

n ■ «. an * is a video signal coding apparatus 
(corresponding to claim 40) is a v ^ ^ 

according to the 39th invention, character 

~« — - 

filter parameter. inve ntion 
A forty-first invention of the present 

, i m 41, is a video signal coding apparatus 
( corresponding to claim 4 1 ) is a vi * 

. to the 39th or 40th invention, characterized in that 
according to the .iytn ot filter 

aid filter parser determining means selects the 
said filter p process, from a 

parameter for performing the second filter 
olurality of filter parameter candidates, 
plurality ™-esent invention 

A forty-second invention of the presen 

, m 42, is a video signal coding apparatus 
( corresponding to claim 42 ) is a viae 

e ^ 16th to 41st inventions, 
according to any one of the 36th 

.v. * filter coefficient or the filter 

A forty-third invention of the pre 

i ■ m 43.isavideosignalcodingapparatus 
( corresponding to claim 43 ) is a via 

nne of the 36th to 41st inventions, 
according to any one of the 

oharacterized in that the filter coefficient or the 
parameter is a coefficient in the unit of pixel. 
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A f ort y -fourth invention of the present invention 

i • ™ 4 4 » is a video signal coding apparatus 
( corresponding to claim 44 ) is a 

' ' to any one of the 36th to 43rd inventions, 

1 *- said f Uter coefficient determining 
said filter parser determining means deters 
Tf 11- coefficient or the filter parameter * curved 
surfa ce apprcimation using the vi.ua! ^ ^ 

^ to this ~— ;; e interpolation 

r- * filter parameter is calculated oy y 
I^U^ T herefore,thecontinuit y ina b loc* 

l^f ace can *e maintained, and a visual improvement can >e 

realized. DreS ent invention 

A forty-fifth invention of the present 

„■ ,oclaim45) is a video signal coding apparatus 
(corresponding to claim 4b) 

* <-h«> 36th to 43rd inventions, 

— - - - r.; . , u — — « 

visual importance can be placed 
a auction in the number of circuits in 
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can be realized. invention 
A forty-sixth invention of the presen 

i i» 46) is a video signal coding apparatus 
(corresponding to claun 46) is a v 

1 nf the 36th to 43rd inventions, 

according to any one of the 36 deterffii „ing 
cha racteri Z ed in that said filter coef 

• f i Iter parameter determining means periorm 
means or said filter param and, when 

block constituting the input image, an 
section on a b lo - _ ^ ^ ^ 

an edge exists, places * ..^ 
interface, and determines the filter 

^ d visual importance can be placed 

- : ... - - 

in an interface of an edge in 

be preserved, and an movement of the unage quality 

^forty-seventh invention of the present invention 
(co rre ^ to claim 4 7 > is a video signal coding apparatus 

«. of the 36th to 46th inventions, 
according to any « - * — 
ch aracteri Z ed m that said ^ ^ ^ ^ 

produce a difference image, and 

to a picture type of the input ^ ^ ^ 

— IZ:";!^ ^tor 
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he calculated at a higher accuracy, and 
vis ual stance can be calcu ^ ^ 

approvement of the image quality of a 

be realized. nrese nt invention 

x forty-eighth invention of the present 

, ^48) is a video signal coding apparatus 
corresponding tocla,, 8 ,s 

.cording to any one o - - ^ _ 

oha racterized in that said ^ by 

C"o^ector corresponding to a picture type 

of the input image- invention 
* forty-ninth invention of the pre 

n ta 49,isavideosignalcodingapparatus 
< corresponding to claim 49 ) is a v 

• . hat said apparatus comprises: 

■ in the unit of block on an input image, to 
vector detect^ he 

pro duceits m otio v- ^ a difference 

of information of the 

image; _ aT _ for calculating 

filter parameter calculating means 

■ a bloc* in the unit of block, from the 
visual importance an a block 

block type information, and the 
input image, the block typ parame ter for 

and calculating a filter p 
difference image, ana c from 

Hpflree of filtering in the unit of pixe 
controlling a degree or i 

the visual importance; 
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f ilte r efficient — — ^ determlnin9 t 
,-4. ^-f filter coefficient 
a filter coefficient fro. a plurality of 
candidates, based on the filter parameter; 

filter calculating means for performing a filter 
filter u filter coefficient 

calculation on the input image by using the 
to produce a filter image, ^ 
mnHQn compensating means tor P 

on 1 f il- b y using the motion vector 

compensation on the fx ^ ^ 

and the block type mf ormation, to p 

lma9e ' ^ ns for performing coding on the second 

coding means for peri. 

difference image to produce a coded data ^ 
wording to this configurate, a filter P 

„« lower visual importance, to reduce 
conducted on a region of lower^ ^ _ ^ 

allocated to a region of higher 

„ guality can be improved ^ 
A fiftieth invention of the present 

, ■„ s01 is a program recording medium 

any one of the 2na computer 
to 21.*. 27thto31st, and34thto49t h inventions by 

is stored in said medium. 
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— -T^^ : — — - 

F g * ^ hv the video signal 

, ■ of a bit stream which is coded by the v 
in coding of a bit sx. ^ lon Q £ Fig. 1, by 

.hod of Embodiment 1 of the invention 

meth0d * a f —art a video si^ai codin, 

, t 1 of the inve^i- which is different 
method of EMbod^nt 1 of the 

from "1'fi^i^---— hodu ^ 

^ rh is coded by the video signal 
* = nit stream which is cuuc 

" C " in9 t l of ^od^ , of the i^ion of ««,. 3. * 

meth0d r g F Tisa bioc* of a video si g nai codin, 

apparatus of * 2 of - invention ^ 

^^^T/onrinl-nwhichisdifferent 
apparatus of Embodiment 2 of the 

9 ' • t 2 of the invention which is different 

apparatus of Embedment 2 of the 

£r0m t 9 . I rt^dia^of adecodin. apparatus which 



- 42 - 



. r> Q f the invention, 
^thod of E^od^ent coding 
Fig . 10 is a bloc* diagram of 

4- ^ of the invention. 

Fig. 11 13 a oianal coding 

. ^ 1005 of the video signal 
Ration e— ^ 5 invention . 
apparatus of Bntood-ent 3 of ^ 

Fi g. 12 is * bl ° ck diagram 
atu s of E^od^t 4 of the invent.cn. 

^ Z 13 is a diag^ of — — »• 

j n of the invention. 

„ — — — — .tt; 

■ ^ance in Embodiments 5, b, fr 
activity and visual stance i 

and 10 of the invention. calculatio n of a filter 

ifi is a view showing a calcui 
Fig ' 16 • ^ P unit of block by curved 

~ . -filter parameter m the unit o 
parameter from a filter P and 7 of the 

• a Hnn in Embodiments 5, b, 
surface approximation m 

invention . ionships between a filter 

parameter and a filter 

invention. ra iculation of a filter 

Fig . 18 is a view showing a calcu 
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. .: nn i n Embodiment 9 of trie mve 

Fiq. 22 is a view illustrating 

* ^hanae of a motion vector, 
importance by detection of a change 

Best Mode for Carrying Out the Invention 

Hereinafter, events of the invents will 
ascribed with reference to drawings. 

^.-^ The video signal 
1 the invention, me vj-^ 

coding method of the emo ^ ^ 

. „„ Hat even when a bit streau 
is performed so that, ev 

produced by a first compression syst^s , a ,s 
^esiredcodeamountistransformedtoabits ^ 

compression system, the code amount can be se 

desired code amount. svste m, DC 

in the above-mentioned first compression sys 



- 44 - 



entS «hi=h are obtained b y a pplY^^(Disoret e cosine 
components wni.cn ar . ^ 

length, AC co p ^ oonponents 

additional information is added to the 

L prod.ce a b it stream, and the bit stream is ^ecor e. . 

contrast, in the second compression s y stem brt 

is received from the first compression system. 

^dtofised-lengthrecording.butcoded 
components are not applied to fixed 9- 

by flying OPCM (D iff-nce Predictive Coding, 

D olied to variable length decoding 

the first compression system. «*Utx 

— — rr— 

compression system, and a bit stream 

<-« *nd the additional information, 
and AC components and the a 

«-f a hit stream in tne xii-a*- 
First, the production of a bit st 

the first compression system, 
a bit stream in the in.**- 

In the first compression system, as ShOM n - - 
■ t- diaital video signal is first DCT transformed. 

: — — — — - — — ar ; 

rcoTdld at a fixed length. *~ — — " 
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recorded - a f ised length by a — — » 

standard of the first cession system. AC componen ts of 

the « transformed digital — — « 

by «. — — - - — °r d r d 

co m,ressionsystem. When the amount of the ^antized and code* 

thelit streamproducedby the first cession systemcannot 
be transmitted, xn the quantisation of the AC events 
therefore, the quantization must be perforce, so that the 

1 ^determined co d e amount. Xn the case .here, fromth 

„ , P dbv the first compression system, another 
bit stream produced by tne nrs 

bi t stream is to be produced by the second compression system 
Ten the code amount of the bit stream fails to be set ^ 
the predetermined code amount, the bit stream proved by ^ 
sec ond compression system cannot be transmitted 
W or d s , in or d er to enable the bit stream produced by the f 
omission system to be transmitted, and also to enable - 
bi t stream produce, by the second cession system to - 
a selection of the method of quanting the 

transmitted, the selection = „, fic ally 
nts in the first compression system, or specially 
AC components in the ■ n a the AC components 

a quantiser which is used for quanting the 
in the first compression system is important, 
in tne n components in 

Therefore , a method of quantizing the AC c 

. < e the selection of a 
the first compression system, i.e., the 
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First, with respect to the DC components of the OCT 

transformed signai, the co d e a— in the case where th oc 

components are coded by applying DPCM (0— ce Pre ^e 
Coain^per.ormeaintheseconacompressions.stem.sest.matea 

Nex t, a first additional information amount in the case where 
the actional information is compressed in the first *~ 
^ a second additional information amount in the case where 
th e additions information is compressed in the second system 
are obtained. 

By using the above-mentioned information, a larger one 
is obtained among the code amount of the DC components in the 
case where coding is performed in the first compression system 
and the code amount of the DC component appXied with 
t he case where coding is performed in the second compression 
sy stem. Snarly, a Xarger one of the first addit.onai 
formation amount in the case where coding is performed 
the first compression system, and a second additionai 
information amount in the case where coding is performed « 
the second compression system is obtained. 

Nex t, a value which is obtained by subtract^, from 
th e predetermined code amount, the thus obtained larger one 
o£ the code amount of the DC events in the case where coding 
is formed in the first compression system, and that ,n the 
casewherecodingisperformedinthesecondcompressionsystem. 
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a „d the Xar g er one of the — — 

the second additionaX i-rmation amount - caXcuXated 

4- allocation for the AC components, 
as code amount alloca-cio» 

T — , a quantiser - seXected W hich, t e . 

the code amounts of both the AC components after 
^h ~din g s to b e set within - «~ ~— 
^amount for the AC components. Th e AC comp onen t ~ 
^ n t iZ e da nathe nVar ^eXe ngt hco d e dby u Si n gt hese^te d 

tizer The information of the used quantiser, the DC 

"1 1 the additionaX —ion .re added to the 
components, and ^ ^ f ^ 

co d ed AC components to produce . first bi 
compression system. 

Next, a method of transforming the first b 

<-n a second bit stream 
produced in the first compression system to secon 
of the second compression system wiXX be described. 

^^..shows.methodoftransfo^thefirstbitstream 

W hich is Produced in the first compression system as descnb^d 
re.tothesecondbitstreamofthesecondcompressic^ 

As shown in 2. «- ««* - -~ — - * ^ 

• inmt the DC components are coded by 
compression system is input, the D 
appXyinq DPCM difference Predictive Coding,, - 
litioll information is coded by appXying coding in the 
^compressionsystem. The AC components are transformed 



nents in the second compression system by appXyin, 

the second brt stream in the ts , 
produced from the DC components, the AC P 

»i„h »re coded in the second 

second bit stream ^ f 
bit stream, and nence «vi 

at wh ich transmission is enabled ^ ^ 

In the above, the example has b^en ^ 

in th e first compression system whe > ^ ^ 

to „ coded, codin, is performed - J- _ ^ 

x rn the following, an example will be 

~- — — — » 

— — — ■ r Tjr:::-!,.^. 
-*"•— -"r; - - »• — 
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1 and 2 



Fig 3 is a flowchart illustrating a production of a 

' i„ a first compression system which is different 
bit stream in a tirst 

• , „nd Fia 4 is a flowchart illustrating 
from that of Fig. 1, and Fig. 

a .ethod of transforming the .it stream produced in the 

„ •„ = ia 3 to a second bit stream in 
compression system shown m Fig. 3 to 

the second compression system. 

t*i~ 1 DPCM (Difference 
in the method shown in Fig. 1. < 
active Coding > is used only for estimating the code amount 
in the application of OPCH on the vc components . By contrast . 

Pr edictive Coding, is used not only for es«ing t e c . 

„t in the application of M CM on the 00 

also for producing the b it stream together with the estimation 

of the code amount. 

AlS o in the coding method shown in Fig. 3. as described 
in the coding method shown in Fig. 1. with respect to the « 
components of the « transformed signal, a larger one of the 
code amount of the OC components, and that in the case*^ 
coding is Performed by applying DPCM ^formed is obtained- 
„ the first additional information 
Furthermore, a larger one of the 

„t in the case where coding is performed in the fi~* 
compression system, and the second additional information 
lint in the case where coding is formed in the second 

compression system is obtained. 
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Next , a value which is obtained by subbing, from 
4- the thus obtained larger one 
the predetermined code amount, the thus 

* of the DC components and that of the DC 
of the code amount of the DC c p 

— nr. m — 

,« « »»• ■ "»"""" " 

a. «^r- The information or 

coded by using the selected 

d ^antizer, the DC components which has applied DPCM, 
the used quantizer, ooded 
and the first additional information are 

a „o * first bit stream in the first 
Ac components to produce a first d 

^~r^-— — ngm— 
ln F ig. , although a method of decoding the first b,t stre^ 
p ^^oducedbythemethodshowninng. 3 to transform* to another 
produced y ^ D(; components 

se condbit stream - shown - -o J ^ 
, « different from the cases of Figs . 

SZ, . — — - — - - — 

the case of Fig. 2. 
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K in the video signal coding method 
ASd Tltri;vlln. session in 
of pediment - ^ ^ oonsideration of the 

^ eSSi0nSy ;rc ewhe r e coding i^e^on.edintKe second 

code amount m ^ ^ code _ n ts a* both the 

compression system. ^ ^ ^ compression 

first bit stream which P fcy 

^ Kii- stream which is <jw^ 
system, and the second tat compr ession 

..v.- first bit stream in the secona 
™" t to f all wi thin a predetermined code amount, 
system can be set to ta pediment is an 

--- Si ° n t:;;: lained by another 

sample, and the same effects^ ^ ^ 

configuration, m sugary, coding P ^ ^ 

„ f-hat a value that is obtameo oy 
controlling so that a v „ han aed each time when 

• hi nh the code amount is changed e 
element in «hich ^ hlgh -ef f iciency 

bit .ream tran^tio" ^ ^ _ „ £ the code ^nt 
codings is Per, * ^ ^ rf ^ variable 

- -responding data o ^ ^ ^ „ 

code amount, such as aa AcCO rding to this 

configuration, even when bit prede termined 
performed.thecodeamountdoesnote.ee 

code amount. ^ kinds o£ 

ln the embedment, the numtoer 

« ,,sed has been described, 
compression systems are used tQ two , 

o£ the tods of compression systems is 
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f . pr for quantizing AC components may be 

^rrrr-U'— — — — 

■ ^ first compression system is 
quantizing AC components m the first c 

1 OCT transformed DC components are used 

to ta s r;rr d — - - - — 

eStimatl " 9 " d by applying DPCM on the DC components, 
which are obtained by applying 

■ , in order to estimate the code amount, OCT 

====== 

~ n „ f dct transformed DC components, 

the value as the value of DCT tra 

(Embod iment 2) coding 
Fia 5 is a block diagram of a video 
ara J'of Embodiment 2 of the invention, 501 denotes an 
^Inalintowhichadigitalvideosignalistob^input, 

i transformer which performs 
502 deno tes an orthogonal ^ ^ ^ 

orthogonal transformation on the inpu 
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^ o . _.i 504 denotes a 

o„theinputs ig nal. ^ ^ AC 

determines a quantiser that ^ ^ ^ ^ 

events of ^ ^ which 

506 den0tSS ^ " L -ration — * — - - 
^ 3 T 507 -notes a ,C component code amount 
inpu t video s 19 nai. 5 ^ ^ of K 

estimator which estates a c ^ ^ & ^ ^ 

components of the input « . The compression method 

p.oducerwhiohproducesao.ts ^ ^ 

" 

pediment 2 of the invent.onw.il 

„^ ... — "-rnc- - - 

j. rvo a nd then output to tne q 
transformer 502, the additi onal information amount 

estimator^. - -^^ e9tima tor 507 estimates 

^TlnTe ate where codings perked on. 
the code amount m tn DPC!4 (Difference 

components of the input s ig nal b y app^ 
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Col g )wi tht ^o £ OC Ttra ns f o rmedD Ccc ffl ponen tS .an d ou t puts 

• f the larger code amount to the quantxzation 
information of the larger 

est^or 505 . - - same time, the 00 comment code amount 
esti^or 50, outputs the ,C components to the tat stream 

Pr0dU0 The "additional information amount estimator 506 
e „ . first additional information — * ~ ~ 
Mh ere the additional information is compressed ,n tne^t 
om.ressions.tem.andasecondadditionalinformat,— 

in the case .here the additional ^s 
in the second compression system, compares 

th each other, and outputs information of the larger on 
of the code amounts to the quantization estimator 505. * 
the same time, the additional information — ^ 
506 compresses the additional information xn th. 
^eslion .stem, and outputs the result to the « ~ 
* * S08 as first additional information. 
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^formation amount estimator 506 and the DC component code 
amount estimator 507, as code amount allocation for 
components. The estimator selects a o.antizer which when 
the A C components are .uantized and variable le ng th coded » 
^efirstco.pressionsysten.andthesecondc^pressionsyste., 

enables both the code amounts of the A C counts after the 
variable length coding to be set within the thus obtained 
located code — t for the *C components, and outputs ,ts 
in formationtotheauanti Z er503. The ^antiser 503 o.antrses 
AC components from the orthogonal transformer S02 b y usrng 
t he g.anti-r which is selected b y the Ration est^ 
505, and outputs the result to the variable length coder 504. 
The variable length coder 504 performs variable length coding 

prod ucer 508. At this ti^e, variable length coded AC 
components, and information of the used o.antizer are sent 
to the bit stream producer 50. 

«ext, the bit stream producer 508 produces a bit stream 
f ro m the DC components from the DC component code amount 
estimator 507, the first additional information from the 
actional information amount estimator 506, the variable 
leng th coded AC components*^ the variable length coder 504 
and the information of the used ^anti.er, and outputs the 

bit stream. 1C 
Rs described above, the video signal coding apparatus 
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a ^determined code amount, both * *- — """^ 

system and the second compression system. 

In the embodiment described with reference to F.g. 5, 

f r om the DC components of the digital video signal which has 
b een orthogonal transformed <DCT transformed, by the 
orth ogonal transformer 50 2 , the DC component code amount 
estimator 507 estimates the code amount in the case where e 
OCcomponentsarecodedbyDPCM.PifferencePredictiveCod.ng, 

amatively, as shown in.ig. 6, the DC component code amount 
estimator 507 of the video signal coding apparatus may not 
be placed in a position su^ent to the orthogonal 
transformer 50 2 , but in a position where the digital v.de 
signal from the input terminal 501 is directly input 
estimator, the value of the OPCM coded DC components wh, 
is estimated by the DC component code amount estimator 507 
^ be regarded as average value of pixels of the digital v.deo 
- nal 501 , and the value may be used, 

signal from the input terminal 501 , a 

In the embodiment described with reference to K.gs. 
-a 6, the digital video signal from the input terminal 501 
is directly input to the orthogonal transformer 50. and the 
DC component code amount estimator 507. alternatively. » 

Jo, for example, blocKs each consisting of 8 x 8 or 64 pixels 
^ be disposed between the input terminal 501 and the 
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ort hogonaX transformer 5.2. ana, in r,, a bXoc* dxvxder 
Ihich divides the digital video signaX into 

Jsformer S.a. an. between the 1^ — S .X and the 
. component code amount ^ 2 

The video signal codxng apparatus or 
described with reference to Fig. 5 is an apparatus 
Responding to the video signal coding method of — 
aescLdwithre.erenceto.ig. X. Xn addition to the v.deo 
slgna x coding apparatus of Embodiment 2 — — ~* 

e erence to 5. -re is a video signaX coding apparatu 
"residing to the video signaX coding method of Kmbodxme 
d esc led with reference to rig- 3. Xn the video s.gna 

to the video signai coding 
coding apparatus corresponding to 

m ethod of Fig- 3, th. circuit is configured so that the 

aD oXied to DPCM not onXy in order to seXect 
components are appXxed to d 

a qu anti Z er for quantising the *C components , and a bit stream 
produced by using a resuXt of coding of the ,C components 
- h a ca se in the same manner as the video 

byM CM. fi Xsoxnsuchacase,i 

signaX coding apparatus shown xn Fxg. 5, the 

9 second compression 

b oth the first compression system and the 
system, the code amount of the produced bit stream can 
w ithxn a predetermined code amount is attained ^ 
In the e^odiment described with reference to Fig. 
ot6 ,productiono £ abitstreaminthefirstcompressionsystem 
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has been described. Next, a video signal coding apparatus 
wh ich can simultaneous produce a bit stream of the 
compression system and that of the second compression system 
will be described with reference to Fig. 7. 

in Pig. 7, 701 denotes an input terminal into which a 
video signal that is identical with the digital video signal 
input to the input terminal 501 of Fig. 5 is to be input, 702 
denotes an orthogonal transformer which performs orthogonal 
transformation on the input signal, 703 denotes a quantizer 
W hich quantizes the input signal, 704 denotes a first variable 
length coder which performs first variable length coding on 
the input signal, 705 denotes a first variable length decoder 
which performs first variable length decoding on the rnput 
signal, 706 denotes a second variable length coder which 
performs second variable length coding on the input signal, 
707 denotes a quantization estimator which determines a 
quantizer that is to be used for quantizing AC components of 
the digital video signal in the quantizer 703, 708 denotes 
an additional information amount estimator which estimates 
an additional information amount in coding of the input video 
signal, and 709 denotes a DC component code amount estimator 
which estimates a code amount in coding of DC components of 
the input signal. The input terminal 70! is identical with 
the input terminal 501, the orthogonal transformer 702 « 
Identical with the orthogonal transformer 502, the quantizer 
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703 is identical with the quantizer 503, and the first variable 
length coder 704 is identical with the variable length coder 
504. Furthermore, the quantization estimator 707 isidentioal 
with the quantization estimator 505, the additional 
information amount estimator 708 is identical with the 
additional information amount estimator 506, and the DC 
component code amount estimator 709 is identical with the DC 
component code amount estimator 507. 

Pig. 7 shows a method of transforming a first bit stream 
which has applied the first variable length coding to a second 
bit streamwhichhas applied the second variable length coding. 
X video signal which is input from the input terminal 701 rs 
transformed into a bit stream which has been compressed and 
applied to the first variable length coding, by the orthogonal 
transformer 702, the quantizer 703, and the first variable 
length coder 704. In order to output a bit stream which has 
applied the second variable length coding in the compression 
process, one of methods of coding the quantized video signal 
by the second variable length coder 706, and of decoding the 
videosignalwhichhas applied the first variable length coding, 
by thefirstvariablelengthdecoder70 5 ,andcodingthe decoded 

signal by the second variable length coder 706 may be used. 

Next, Fig. 8 is a block diagram of a decoding apparatus 
which decodes the bit stream produced in Fig. 7 . In Fig. 8, 
801 denotes an input terminal into which the compressed brt 
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stream from the first variable length coder 704 is to be input, 
802 denotes a first variable length decoder which performs 
flr st variable length decoding on the input signal, 803 denotes 
an inverse quantizer which inverse quantizes the input signal, 

804 denotes an inverse orthogonal transformer which performs 
inverse orthogonal transformation on the input signal, and 

805 denotes a second variable length coder which performs 
second variable length coding on the input signal. 

Pig . 8 shows a method of, in a decoding process, 
transforming a bit stream which has applied the first variable 
length coding to a bit stream which has applied the second 
variable length coding, and that of decoding the bit stream 
which has applied the first variable length coding. A bit 
stream which is input from the input terminal 801 is expanded 
(d ecoded> by the first variable length decoder 802, the inverse 
quantizer 803, and the inverse orthogonal transformer 804, 
to be transformed to a video signal . The output of a bit stream 
which has applied the second variable length coding in the 
expansion process is enabled by decoding the input signal by 
the first variable length decoder 802, and coding the decoded 
signal by the second variable length coder 805. As a 
configurationfor the above, as shown inFig. 8, a configuration 
in which the first variable length decoder 802 and the second 
variable length coder 805 are disposed inside the decoding 
apparatus, oranother configuration inwhichthe first variable 
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le ngth decoder S03 ana the second variable -gth ~~ 5 

J«* — - — — but disp ; e 

utside the — apparatus - be - - 

fi rst variable length decoder S0 2 an. the secon d var^e 
„=h inside the decoding apparatus, 
iengthcoderBOSmaybed.sposedmsxdet 

or outside the appals. ' - 

variable length d ecoder ,0, an d the second viable lengt* 
coder 70S of the video signal coding apparatus shown » 

or outside the video signal coding apparatus. 

rigs . , an d 8 show configurations in which only the 
var iablelengthcodingisch a nged. T he co d ing o £ OC exponents , 
and the transition to additional information for a b.t 
l.areperidinthesa.e.anner as the trans— 
f or items other than A C exponents which have been descried 
with reference to Figs. 2 and 4. 

The egression system used in above-desc-bed 
^odi^ntxand^odi.ent.isanexa.ple.andthesa^e^ects 

oan be attained by another configuration, m su^ry . cod^g 
s performed while controlling so that a value that « obtained 
^dding ~ an element in which the co d e amount * «- 
each time when bit stream transformation between different 
gh-efficiency codings is performed, the ma X imu» i va lu^o 
1 code .mount of corresponding data other than the element 
o the variable code amount, such as additional information 
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is equaX to or smaXXer . P— code amount. 

Ac cordin 9 to this conflation, even when *t stream 
transformation is performed, t h e code amount — «* 
the predetermined code amount. 

xn ab ove-descri b ed Embodiment 1 -d Embodiment 2, 
Mh ere two Xinds of compression systems are used has been 

not Ximited to two, and three or more Kinds of compress. 

he used in this case, it is required only that 

r lunts of .it streams which are respective, priced 
in the compression systems are equaX to or smaXXer than 
predetermined code amount. 

In ab ove-descri b ed Embodiment 1 and Embedment 2. 
al thou 9 h the de g ree of grantee is Xowered, the seXect.on 
Z quantiser for quanta *C components may be per, orme 
IhiXe omittin, a part such as prediction of the amount 
ad ditionai information or DC components. 

In the a b ove. the means constitute the video s^naX 
-din, apparatus of Em* odimen " « ^ 
Al ternativeXy, the whoXe or a part - 

ha vin 9 the same functions as correspond^ ones of 
above-mentioned hardware. 
(Embodiment 3) 
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Next, . video signal coding method and a video signal 
coding apparatus of Embodiment 3 of the invention will be 
described with reference to rigs. 9, 10, and 11. 

Pig. 9 is a flowchart illustrating the video signal 
coding method of Embodiment 3 of the invention, and Fig. 10 
is a block diagram of the video signal coding apparatus of 
EntoodimentJof theinvention. rig. llwillbedescribedlater. 

as shown in Fig. 10. the video signal coding apparatus 
of Embodiment 3 of the invention is conf iguredby an orthogonal 
transformer 2002, a quantizer 2003, a variable length coder 
2004, a quantization estimator 2005, an additional information 
amount estimator 2006, a DC component code amount estimator 
2007, and a bit stream producer 2008. 

The orthogonal transformer 2002, the quantizer 2003, 
t he variable length coder 2004, the additional information 
amoun testimator2006,andthebitstreamproducer2008operate 

in the same manner as corresponding ones of the orthogonal 
transformer 502, the quantizer 503, the variable length coder 
504, the additional information amount estimator 506, and the 
bit stream producer 508 of above-described Embodiment 2 of 

Fig. 5, respectively. 

Bycontrast,thefunctionsofthequantizationestimator 

2005 and the DC component code amount estimator 2007 are 
different the function of the quantization estimator 505 or 
the DC component code amount estimator 507 of Embodiment 2. 
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„. , 3 therefore, differences from Embodiments 1 
in Embodiment 3, tnereioi , 

and 2 will be described. estima tes 
The DC component code amount estimator 2007 

rtlrti™ code amount in the case where 

obiect of the quantization, 
as the oojecx. v*. -» e( arond 
The quantization estimator 2005 estates a secon 

nt of a total of the difference pred.ct.ve 
8ys tem code amount ^ ^ fay the DC component code amount 
code amount whxch xs estxmated by ^ 

• ^ 2007 and the code amount xn the case wner 
estxmator 2007 ^ ^ 

-condcompressx^ ^ ^ ^ 

on AC components of the digi 

coain e transformed and quantized — ^ ^ 
qua „tizationestimator200 5 comparesapresetxd 

wit h the second system code amount. ^ 

, that of the second system code amount. In fxg. 
and that of th ^ ^ indicated by a 

temporal change o f - ^ ^ ^ ^ 

b ro*en Ixne, and that ^ ^ ^ ^ ^ 

ind ri-;i: n — system code amount in the 
rUre the ideal code amount and the second system code 
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amount are compared with each other at each tiding is hatched. 

in Embodiment 3, the second system code amount means 
a tot al code amount of the difference predictive code amount 
which is previous in time to the transformed signal that is 
t „e ocoect of the quantization, and the code amount in the 
case where variable lengthcoding is perf ormedonAC components 
in the second compression system. The ideal code amount „ 
stepwise increased by a constant value with the passage of 



time 



When the second system code amount is equal to or smaller 
than the ideal code amount as a result of comparison of the 
ideal code amount and the second system code amount, the 
quantization estimator 2005 calculates a value which xs 
chained by subtracting the code amount of information output 
£r om the additional information amount estimator 2006 from 
a predetermined code amount in the first compression system, 
as code amount allocation for the AC components, selects a 
quantizer which enables the code amount to be set within the 
allocated code amount, and outputs its information to the 

quantizer 2003. 

By contrast , when the second systemcode amount is larger 
than the ideal code amount, a value which is obtained by 

amount is subtracted from the predetermined code amount in 
the first compression system, and subtracting from the result 
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the code amount of information output fro, the additional 
information amount estimator 2006 is calculated as code amount 
allocation for the AC components. A quantizer which enables 
the code amount to be set within the allocated code amount 
ls selected, and its information is output to the quantizer 



2003 



Thereafter, the quantizer 2003 quantizes AC components 
of the input video signal which is the o bj ect of quantization 
and supplied from the orthogonal transformer 2002, by using 
the q uantizer which is selected b y the q uantization estimator 
2005 ,and outputs the resultto the variable length coder 2004. 
The variable length coder 2004performs variable length coding 

producer 2008. 

N ext, the bit stream producer 2008 produces a bit stream 
f rom the additional information from the additional 
information amount estimator 2006, and the variable length 
coded AC and DC components from the variable length coder 2004, 
and outputs the bit stream. 

In above-described Embodi^nt 3, the DC component code 
amountestimator2007 estima t esthedifferencepredictivecode 

amount in the case where difference predictive coding rs 
performed on DC components of a digital video signal whrch 
i. discrete cosine transformed and quantized previously ,n 
time to a transformed signal which is the object of the 
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. t . n Mtematively, the DC component code amount 
quantization. Aiterna 

• tor 2007 may estimate a code amount in the case 
estimator - T ideosignalwhlohia discrete cosine 

DC components of a digital v ^e to a transformed 

^sformedand^uantizedpreviousiy m tim - 

signa i which is the object of the guanti^n »■ . 

a fixed iength, or in other — ^ ^ place 

nredictive coding is performed, and it may 

predictive . ive co de amount. 

h Ts estimated b y the OC component code a,ount 
amount which is estim ^ ^ 

■ +„ r 2007 and the code amount in the cas 

"■".■Z^^-^— -— ■- — i - 
— - — • — — - — 

■*h the first system code amount, 
with the nr= * the second system code 

I» above-described Embodiment 3, the secon 

* „t the difference predictive 
^unt means a tota! code amount of * - 

in the case wi«=i. amatively , 

* in the second compression system. Alternate 
components in the secon _ ^ 
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period immediately -fore the transformed -** 

: jectof t ,^o, -—^t 

not be a total code amount, but a part of the total. 

-—7-— 

avstem code amount is defined. 

^bove-describedKnfcodi^maybe confined as hardware, 
o t; be placed W ith software havin g the ^ functus 
TcoLspo^ ones of the above-mentioned hardware. 
(Embodiment 4) 

co din 9 apparatus of ^odlment 4 - the —n w.ll 

appa ratus of * of the invention. ~ ~ * 

Z the video si g nal codin, apparatus of ~— * « 
Mention is confined b y an ortho.onal transformer »«. 

tiZ er 22 03, .variable len 9 th coder 22 04. a auanti^on 
i:rr 2 ;0 5 ,:-tdetect O r 22 0 6 .as eO ondd e tector 22 C 7 , 

and a bit stream producer 2208. 

T he ortho g onal transformer 22 0 2 , the cuant^er 22 
the variable len g th coder „„«. and the bit strea, produce 

„„*r as corresponding ones of the 
22 08 operate in the same manner cor P 
or tho g onal transformer 50 2 , the quantizer 503, 
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„ der5 04, and the bit stream producer 508 of 
iength coder 504, respe ctively. 

By contra, the f- ^ ^ 505 of 

2205 18 Tt ~— ' 

^^Vos and the OC cogent code ^ount estate, ,07 
estimator 506 and ^ o£ 

whioh are d^sedin ^ ^ ^ ^ apparatu8 of 

pediment 2 of F g. . ^ ^ ^ ^ gecond 

Embodiment 4 composes the f 

detector 2207 ore , dif fences ^Embodiments 

in Embodiment 4 , tnereioi. 

! and 2 will be described. ^ 
Th efir 8 t detector 220 6 detectst h e e ^ 

- «" ^ S19na d ■ £irst additionaX information amount 
compression system, and a firrt ^ 

. v~ added to the input signal in tne 
w hich « to be added ^ ^ the 

the ,C components of the ^ ^ ^ Qf the 

£ir st compression system, and P ^ tl ^ f 

th efirst detector 2206 outp roducer2208 _ 
addition, informationamou -^ ^ ^ ^ 

Thesecond :::::;— - 
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on oc components of the input signal, detects the size of a 
total (secondtotal, of the code amount and a second additiona 
information amount which is to be added to the input srgnal 
in the case where the AC components of the input signal are 
compressed in the second compression system, and outputs the 
information of the size to the quantization estimator 2205 
Tnequantizationestimato^OScalculatesavaluewh^ch 

isobtainedbysubtractin^fromthepredeterminedcodeamount. 

* ^ first total detected by the first detector 
a larger one of the first totaj. 

22 06, and the second total detected by the second detector 

22 07, as code amount allocation for the AC components, selects 
. quantizer which, when the AC components are quantized and 
variable length coded in the first compression system and the 

..„™ cables the code amount of botn 
second compression system, enables tne 

the AC components after the variable length codings to be set 
W ithin the thus obtained allocated code amount for the AC 
components, andoutputs its information to the quantizer 2203. 

Thereafter, the quantizer 2203 quantizes the AC 
components of the input video signal which is the , object of 
qua ntizationandsu P pliedfromtheorthogonaltransformer2202, 

by using the quantizer which is selected by the quantization 
estimator 2205, and outputs the result to the variable length 
coaer 2204 . The variable length coder 2204 performs variable 

the bit stream producer 2208. 



- 71 - 



Next, the bit stream producer 2208 produces a bit stream 
from the DC components and the first additional information 
from the first detector 2206, and the variable length coded 
AC components from the variable length coder 2204, and outputs 

the bit stream. 

in above-described Embodiment 4 , the first detector 2206 
detects the size of a total of the code amount in the case 
where the DC components of the input signal are recorded at 
a fixed length in the first compression system, and the first 
additional information amount, and the second detector 2207 
detects the size of a total of the code amount in the case 
where coding is performed by applying DPCM (Difference 
Predictive Coding) performed in the second compression system, 
on DC components of the input signal, and a second additional 
information amount. Alternatively, the first detector 2206 
may detect the size of a total of the code amount in the case 
where coding is performed by applying DPCM (Difference 
Predictive Coding ) performed in the second compression system, 
on DC components of the input signal, and set the size as the 
first total, and the second detector 2207 may detect the size 
of a total of the code amount in the case where the DC components 
of the input signal are recorded at a fixed length in the first 
compression system, and the first additional information 
amount, and set the size as the second total. 

Themeans constituting the video signal coding apparatus 
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„ f above-described Embodiment 4 maybe configured as hardware, 
or may be replaced with software having the same functions 
as corresponding ones of the above-mentioned hardware. 
(Embodiment 5) 

N ext, Embodiment 5 of the invention will be described 
with reference to Figs. 13, 15, 16, and 17. 

InFig. 13, 901 denotes an inputting section, 902denotes 
a motion vector detecting section, 903 denotes a filter 
parameter calculating section, 904 denotes a filter 
coefficient determining section, 905 denotes a filter 
calculating section, 906 denotes a motion compensating section, 
907 denotes a coding section, 908 denotes a local decoder, 
and 909 denotes an outputting section. 

The operation of the thus configured embodiment will 

be described. 

An image signal which is input fromthe inputting section 
901 is input to the motion vector detecting section 902, the 
filt er parameter calculating section 903, and the filter 
calculating section 905. Xrrespective of the picture type 
of the input image, the motion vector detecting section 902 
performs motion vector detection on the input image with 
respect to a reference image stored in a memory, and outputs 
amotionvectorandafirstdifferenceimage. The motion vector 

section 906, and the first 
is input to the motion compensating section 

■ • fofh P filter parameter calculating 
difference image is input to the filter pa 
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section 903 respectively. 

The filter parameter calculating section 903 calculates 
a first activity in the unit of block from the input image, 
and a second activity in the unit of block fron, the first 
di fference image, rrom the first activity and the second 
activity, thereafter, visual importance which indicates the 
aegree of visual importance in the unit of block with respect 
to the input image is calculated. In a region containing an 
edge and the like, the first activity is large, but the second 
activityissmallbecausethemotioncompensationiseffectxve. 

By contrast , in a region containing a signal of high randomness 
such as noises,both the first activity andthe second activity 
are large. 

In the casewhereasumof absolute values of differences 
between an intrablock pixel and a block average is used as 
an activity, with respect to a region containing an edge and 
the like, usually, it is often that the first activity is 1,000 
or larger and the second activity is 100 or smaller, and it 
is characteristic that the second activity is smaller than 
the first activity. By contrast, with respect to a signal 
of high randomness, it is often that both the first activity 
and the second activity are 1,000 or larger, and xt « 
characteristic that the second activity does not become small . 

in the specification, the visual importance is a degree 
a t which a man pays attention when evaluation is performed 
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on an image. With respect to a region of high edge and 
saturation, a man pays attention at a high degree, or visual 
im portance is high. With respect to a region of high noise 
and randomness, aman pays attention at a low degree, or visual 
i.nportance is low. From the visual importance, a filter 
parameter which is a parameter for controlling the degree of 
filtering the unitof pixel on the input image is calculated. 
The filter parameter is input to the filter coefficient 
determining section 904. 

The filter coefficient determining section 904 
de terminesafiltercoefficientfromtheinputfilter parameter. 

T he filter coefficient is input to the filter calculating 
section 905. The filter calculating section 905 performs a 
filter calculation on the input image by using the input filter 
coefficient, to produce a filter image. The filter image is 
input to the motion compensating section 906. 

When the picture type of the input filter image is a 
P-picture or a B-picture, the motion compensating section 906 
produces a predictive image from the input motion vector and 
the reference image stored in the memory, calculates the 
dl f f erence between the predictive image and the filter image, 
and outputs a second difference i.age. The second difference 
i^age is input to the coding section 907. When the picture 
type of the input filter image is an X-picture, the fxlter 
is deemed as a second difference signal, and input to 
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the coding section 907. 

The coding section 907 codes the input second difference 
image, and outputs a coded data. The coded data is input to 
the local decoder 908 and the outputting section 909. The 
local decoder 908 decodes the input coded data and produces 
a decoded image. The decoded image is input to the motion 
compensating section 906 . The outputting section 909 outputs 
the input coded data to recording and transmitting media or 
the like. 

The operation of the filter parameter calculating 
section 903 will be described in detail with reference to Figs . 
15, 16, and 17. In Embodiments 5 to 9, in order to simplify 
the description, each block is assumed to have a size of 2 
x 2 pixels. 

First, with respect to the input image, an average value 
of pixel values in the unit of block is calculated. Differences 
between pixels in the block and the above-mentioned average 
value are calculated, and difference signals are produced. 
A sum of absolute values of the difference signals is calculated, 
and the sum is set as the first activity. Next, with respect 
to the first difference image, a sum of absolute values of 
pixel values in the unit of block is calculated, and the sum 
is set as the second activity. In the embodiment, a sum of 
absolute values of pixels is used as the activity. 
Alternatively, variance of pixels in a block, the magnitude 
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of a sum of absolute values of Hadamard transformed AC 
components, or the like may be used as the activity. 

From the first activity and the second activity, visual 
importance tB which is aparameter indicating visual importance 
in the block is calculated by using a table of visual importance 
shown in Fig. 15. tB is expressed by one of continuous values 
of 0 to 1. As the value is closer to 0, visual importance 
is lower, or the value indicates that the region is not visually 
important. By contrast, as the value is closer to 1, visual 
importance is higher, or the value indicates that the region 
is visually important. 

For example, an arbitrary block b will be considered. 
When the first activity of the block b is 2,000 and the second 
activity is 1,000, tB of the block b is 0.7 from the table 
of Fig. 15. This table is an example, and the thresholds of 
the activities and the value of tB may be changed. In the 
above example, when the first activity of the block b is 2,000 
and the second activity is 1,000, tB is 0.7. This value may 

be set to be 0.6. 

Thereafter, a filter parameter tP which is a parameter 
for controlling the degree of filtering in the unit of pixel 
is calculated from the visual importance tB. The calculation 
is performed by the following method. As shown in Fig. 16, 
tP of a pixel in a block is set to be tB of the block. In 
Fig 16, 1200 to 1208 denote blocks, and 1210 to 1218 denote 
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visua l stance tB of the blocKs. Bach visual importance 

be longs. The values of the visual importance are as follows: 
1210 h a s0.7; 1211 has 0.5; 1212 has 0. 5i 1213 has 0.7; 



has 0.5. 



The block 1204 will be considered. Filter parameters 

value as the visual importance of the bloc, 1204. X. other 
words, the values of the filter parameters 1220 to 1223 of 
the pixels in the bloc, !204 are as follows: !220 has 0.7, 
122 1 has 0.7, X222 has 0.7; and 1223 has 0.7. Thereafter. 
f ro mthefilterparametertP,the filter coefficient of a f .Iter 
whlc h is to be used for processing the pixel is determined 
by using a filter coefficient table shown in 17- — 

tP is 0.7, a filter coefficient is selected to be 3. 

As described above . visual importance of the input image 
is calculated from the input image and the difference image 
and a filter process is performed on a region of low visual 
importance, thereby reducing the information amount. As a 
res ult, a larger code amount can be allocated to a region of 
hi ghervisual importance, and improvement of the image oualxty 

can be realized. 

In Embodiment 5 described above, visual importance 
calculated^usingthefirstactivityandthesecondactivity. 



Alternatively, visual importance may be calculated by using 
the orientation and/or the size of the motion vector of a noted 
block, or the noted block and blocks (for example, adjacent 
eight blocks) adjacent to the block. 

Specifically, visual importance can be calculated by 
detecting the manner of changes of the orientations and/or 
the sizes of the motion vectors of a noted block and blocks 
adjacent to the block. For example, calculation of visual 
importance based on changes of motion vectors will be described 
with reference to Fig. 22. In the case where temporal and 
spatial correlations of images are high, motion vectors of 
a noted block and blocks in the periphery of the block are 
arranged as shown in Fig. 22(a). By contrast, in the case 
where temporal and spatial correlations are low, such as the 
case of water splash or white noises, motion vectors are 
arranged as shown in Fig. 22(b). In the case of Fig. 22(a), 
visual importance is high. By contrast, in the case of Fig. 
22(b), visual importance is low. 
(Embodiment 6) 

Hereinafter, Embodiment 6 of the invention will be 
described with reference to Figs. 14, 15, and 16. 

In Fig. 14, 1001 denotes an inputting section, 1002 
denotes a motion vector detecting section, 1003 denotes a 
filter parameter calculating section, 1004 denotes a filter 
calculating section, 1005 denotes a weight calculating section, 
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1006 denotes a motion compensating section, 1007 denotes a 
coding section, 1008 denotes a local decoder, and 1009 denotes 
an outputting section. 

Next, the operation of the embodiment will be described. 

An image signal which is input from the inputting section 
1001 is input to the motion vector detecting section 1002, 
the filter parameter calculating section 1003, the filter 
calculating section 1004, and the weight calculating section 
1005. Irrespective of the picture type of the input image, 
the motion vector detecting section 1002 performs motion vector 
detection on the input image with respect to a reference image 
stored in a memory, and outputs a motion vector and a first 
difference image. The motion vector is input to the motion 
compensating section 1006, and the first difference image is 
input to the filter parameter calculating section 1003. 

The filter parameter calculating section 1003 
calculates a first activity in the unit of block from the input 
image, and a second activity in the unit of block from the 
first difference image. From the first activity and the second 
activity, thereafter, visual importance which indicates the 
degree of visual importance in the unit of block with respect 
to the input image is calculated. From the visual importance, 
a filter parameter which is a parameter indicating the degree 
of filtering in the unit of pixel on the input image is calculated 
The filter parameter is input to the weight calculating section 



- 80 - 



1005. 

The filter calculating section 1004 performs a filter 
calculation on the input image with a specific filter 
coefficient, and outputs a first filter image. The frrst 
filter image is input to the weight calculating section 1005. 
The weight calculating section 1005 performs a weighing 
calculation based on the filter parameter on the first filter 
image, and outputs a second filter image. The second filter 
i^age is input to the motion compensating section 1006. When 
the picture type of the input filter image is a P-picture or 
a B-picture, the motion compensating section 1006 produces 
a predictive image from the input motion vector and the 
.eferenceimagestoredinthememory.calculatesthedifference 

between the predictive image and the filter image, and outputs 
a second difference image. The second difference image x. 
input to the coding section 1007. When the picture type of 
the input filter image is an I-picture, the filter image is 
deemed as a second difference signal, and input to the coding 

section 1007. 

The coding section 1007 codes the input second 

difference image, and outputs a coded data. The coded data 
is input to the local decoder 1008 and the outputtin, section 
1009 The local decoder 1008 decodes the input coded data 
and produces a decoded image. The decoded image is input to 
themotion compensating section 1006. The outputting section 
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X009 outputs the input coded data to recording and transmitting 

media or the like. 

The operation of the filter parameter calculating 
section 1003 will be described in detail with reference to 
Figs. 15 and 16. First, with respect to the input image, an 
averagevalueof pixel values in the unit of block is calculated. 
Differences between pixels in the block and the above-mentioned 
average value are calculated, and difference signals are 
produced. A sum of absolute values of the difference signal 
values is calculated, and the sum is set as the first activity. 
Hext, with respect to the first difference mage, a sum of 
absolute values of pixel values in the unit of block is 
calculated, and the sum is set as the second activity. A sum 
of absolute values of pixel values is used as the activity. 
Alternatively, in the same manner as Embodiment 5, variance 
of pixels in a block or the like may be used as the activity. 
From the first activity and the second activity, tB of the 
block is calculated by using the table of visual importance 

shown in Fig. 15. 

For example, an arbitrary block b will be considered. 
When the first activity of the block b is 2,000 and the second 
activity is 1,000, tB of the block b is 0.7 from the table 
of Fig. 15. Thereafter, a filter parameter tP which is a 
parameter for controlling the degree of filtering in the unit 
of pixel is calculated from the visual importance tB. The 
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calculation is performed by the following method. As shown 
in Fig. 16, tP of a pixel in a block is set to be tB of the 
block. 

When tB in a certain block is 0.7, for example, tP is 
0.7 in all of four pixels in the block. This tP is used as 
a weighting coefficient in a weighting calculation. 
Specifically, a weighting calculation in an arbitrary pixel 
p is performed as indicated by the following (Ex. 1). 

[Ex. 1] 

Value of the pixel p in the second filter image 
= (tP x value of the pixel p in the input image) 

+ ( (1 - tP) x value of the pixel p in the first filter image) 

As described above, visual importance of the input image 
is calculated from the input image and the difference image, 
and a filter process is conducted on a region of lower visual 
importance, to reduce the information amount, whereby a larger 
code amount can be allocated to a region of higher visual 
importance, and the image quality can be improved. 

(Embodiment 7) 

Hereinafter, Embodiment 7 of the invention will be 
described with reference to Figs. 13, 15, and 16. The 
configuration is identical with that of Fig. 13, and the 
operation is identical with that of Embodiment 5 . The filter 
coefficient determining section 904 in the embodiment 
calculates a filter coefficient from the filter parameter tP. 
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The embodiment and Embodiment 5 are different in the 
method of determining the filter coefficient. In Embodiment 
5, a filter coefficient for each pixel is selected from plural 
filter coefficient candidates which are previously set, on 
the basis of the filter parameter. By contrast, in the 
embodiment, a filter coefficient is calculated from the filter 
parameter. According to this configuration, it is possible 
to use a filter having more suitable filter properties. 

As described above, visual importance of the input image 
is calculated from the input image and the difference image, 
and a filter process is conducted on a region of lower visual 
importance, to reduce the information amount, whereby a larger 
code amount can be allocated to a region of higher visual 
importance, and the image quality can be improved. 

( Embodiment 8 ) 

Hereinafter, Embodiment 8 of the invention will be 
described with reference to Figs. 13, 15, and 18. The 
configuration is identical with that of Fig. 13, and the 
operation is identical with that of Embodiment 5 . The 
operation of the filter parameter calculating section 903 in 
the embodiment will be described with reference to Figs. 15 
and 18. 

The filter parameter calculating section 903 calculates 
tB from the first activity calculated from the input image 
and the second activity calculated from the first difference 
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image, by using the visual importance table shown in Fig. 15. 
For example, an arbitrary block b will be considered. When 
th efirstactivityo f thebloc k bis2.000andthesecondactiv 1 ty 

Thereafter, as shown in Fig. 18, curved surface 
interpolation is performed by using tB to calculate tP. 

In Fig. 18, 1400 to 1408 denote blocks, and 1410 to 1418 
d enote bloc, visual importance tB of each bloc,. The values 
o£ the visual importance of the blocks are respectively as 
fol lows: 1410 has 0.7; 1411 has 0. 5i 141, has 0.5 ; 1413 has 
07 . 14 14 ha s0.7, 1.15 has 0.5; 1416 has 0.5, 1417 has 0.5; 
and 1418 has 0.5. Furthermore, 1420 denotes a pixel in the 
bl ock 1404, and 1430 denotes tP of the pixel 1420. 

WHen the pixel 1420 will be considered, 1430 which is 
tP of the pixel 1420 is calculated by curved surface 
interpolation indicated by <Ex. 2, by using four tBs: 1414 

tB of the block 1408. 
[Ex. 2] 

tP of the pixel 1420 

= ,0.75 X (0.75 X tB of the block 1404 + 0.25 X tB of 

the block 1405)) 

+ ,0.25 x (0.75 x tB of the block 1407 + 0.25 x tB of 

the block 1408)) 
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Substituting tB of the block 1404 = 0.7 , tB of the block 

14 08 - 0.5 into (E x. 2> , tP of the pixel 1420 is 0.6125. From 
the filter parameter tP, thereafter, the filter coefficient 
of the filter which is used for processing the pixel xs 
determined byusingthe filter coefficient table shown inFig. 
17. When tP is 0.6125, for example, a filter coefficient rs 

selected to be 3. 

As described above, visual importance of the input image 
is calculated from the input image and the difference image, 
and a filter process is performed on a region of low visual 
importance, thereby reducing the information amount. As a 
result, a larger code amount can be allocated to a region of 
higher visual importance , and improvement of the image gualrty 
can be realized. A filter parameter in the unit of pixel x. 
calculated by curved surface interpolation using vrsual 
importancewhichiscalculatedintheunitofblock. Therefore, 
the continuity in a block interface can be maintained, and 
a visual improvement can be realized. 
(Embodiment 9) 

Hereinafter, Embodiment 9 of the invention will be 
described with reference to Figs. 13, 15, and 19. The 
configuration is identical with that of Fig. 13, and the 
operation is identical with that of Embodiment 5. The 
operation of the filter parameter calculating section 903 xn 
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the anient will be described with reference to Figs. 15 



and 19 



The filter parameter calculating section 903 calculates 
« from the first activity calculated from the input image 
and the second activity calculated from the first difference 
i^age, by using the visual Haportance table shown in Fig. 15. 
,or example, an arbitrary bloc, b will be considered. When 
th efirstactivityoftheblockbis2,000andthesecondactiv^ 

is 1,000, tB of the block b is 0.7 from the table of Fig. 15. 

Thereafter, as shown in Fig. 19, curved surface 
interpolation is performed by using tB to calculate tP. At 
this time, tB is placed in one of four corners of the bloc*. 
InFig. 19, 1500 to 1508 denote blocks, and 1510 to 1518 denote 
visual importance tB of each block. The values of the visual 
imp ortance of the blocks are respectively as follows: 1510 

0.5. Furthermore, 1520 denotes a pixel in the block 1504, 
and 1530 denotes tP of the pixel 1520. 

When the pixel 1520 will be considered, 1530 which is 
„ of the Pixel 1520 is calculated by curved surface 
interpolation indicated by ,Ex. 3, by using four tB.. 1514 

tB of the block 1508. 
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[Ex. 3] 

tP of the pixel 1520 

= (0.5x(0.5xtBof the block 1504 + 0.5 x tB of the 
block 1505)) 

+ (0.5 x (0.5 xtB of the block 1507 + 0.5 x tB of the 
block 1508)) 

Substituting tB of the block 1504 = 0.7, tB of the block 
1505 = 0.5, tB of the block 1507 =0.5, and tB of the block 
1508 = 0.5 into (Ex. 3) , tP of the pixel 1520 is 0.55. Thereafter, 
the filter coefficient of the filter which is used for 
processing the pixel is determined by using the filter 
coefficient table shown in Fig. 17. WhentP is 0 . 55 , for example, 
a filter coefficient is selected to be 3 . 

As described above, visual importance of the input image 
is calculated from the input image and the difference image, 
and a filter process is performed on a region of lower visual 
importance, thereby reducing the information amount. As a 
result, a larger code amount can be allocated to a region of 
higher visual importance, and improvement of the image quality 
can be realized . In curved surface interpolation using visual 
importance which is calculated in the unit of block, the visual 
importance is placed in one of four corners of a block, whereby 
the calculation accuracy of the interpolation calculation can 
be reduced as compared with the case where visual importance 
is placed at the center of a block. Therefore, a reduction 
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of circuits in the calculation section can be realized. 
Furthermore, the continuity in a block interface can be 
maintained by curved surface interpolation, and a visual 
improvement can be realized. 
( Embodiment 1 0 ) 

Hereinafter, Embodiment 10 of the invention will be 
described with reference to Figs. 13, 15, 20 and 21. The 
configuration is identical with that of Fig. 13, and the 
operation is identical with that of Embodiment 5 . The 
operation of the filter parameter calculating section 903 in 
the embodiment will be described with reference to Figs. 15, 
20 and 21. The embodiment will be described with assuming 
that each block has a size of 4 x 4 pixels. 

The filter parameter calculating section 903 calculates 
tB from the first activity calculated from the input image 
and the second activity calculated from the first difference 
image, by using the visual importance table shown in Fig. 15. 

Thereafter, edge detection is performed on each of the 
blocks. If it is judged that there is an edge, tB is placed 
in the edge interface. Fig. 20 shows the placement of tB in 
the case where there is an edge in a block. In Fig. 20, 1600 
denotes a block containing an edge region 1601, and 1602 denotes 
tB which is calculated with respect to the block 1600. As 
shown in Fig. 20, tB 1602 is placed in the edge interface. 
The edge detection is performed in the procedure shown in Fig. 
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21. In Fig. 21(a), 1700 denotes a block consisting of 4 x 
4 pixels , and designations of 100 and 100 indicate pixel values 
of pixels . Accordingly, in the block 1700 , there are fourteen 
pixels of a pixel value of 100, and two pixels of a pixel value 
of 100. Edge detections in the horizontal and vertical 
directions are independently performed on the block 1700. 
First, with respect to the horizontal direction, a position 
where the absolute value of the difference between adjacent 
pixels exceeds a specific threshold value = 100 and is the 
largest is regarded as the horizontal edge interface . Results 
are shown in Fig. 21(b). In Fig. 21(b), 1703 denotes the 
horizontal edge interface. With respect to the vertical 
direction, thereafter, in the same manner as the horizontal 
direction, a position where the absolute value of the 
difference between adjacent pixels exceeds a threshold value 
= 100 and is the largest is regarded as the vertical edge 
interface. Results are shown in Fig. 21(c). In Fig. 21(c), 
17 04 denotes the vertical edge interface. The edge interface 
of the block 1700 is detected from the horizontal edge interface 
and the vertical edge interface. Results are shown in Fig. 
21(d) . In Fig. 21(d) , 1705 denotes the edge interface of the 
block 1700, and tB 1602 of the block 1700 is placed on the 
edge interface 1705. 

As described above, visual importance of the input image 
is calculated from the input image and the difference image, 
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and a filter process is performed on a region of low er visual 
importance, thereby reducing the information amount. As a 
result, a larger code amount can be allocated to a region of 
higher visual importance, and improvement of the image quality 
can be realized . In curved surface interpolation using visual 
importance, the visual importance is placed in an interface 
of an edge in a block, whereby the edge can be preserved, and 
an improvement of the image quality can be realized. 
Furthermore, the continuity in a block interface can be 
maintained by curved surface interpolation, and a visual 
improvement can be realized. 
( Embodiment 1 1 ) 

Hereinafter, Embodiment 11 of the invention will be 
described with reference to Fig. 13. The configuration is 
identical with that of Fig. 13, and the operation is identical 
with that of Embodiment 5. In the embodiment, irrespective 
of the picture type of the input image, the motion vector 
detecting section 902 performs the same motion vector detection 
to produce the first difference image . At this time , the motion 
vector outputs a motion vector corresponding to the picture 
type. 

The embodiment and Embodiment 5 are different from each 
other in the method of calculating the first difference image. 
In Embodiment 5, when the first difference image is to be 
calculated, forward prediction is performed on an I- or 
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P-picture, and bidirectional prediction is performed on a 
B- P icture. or the motion detection is performed in accordance 
with each picture type. By contrast, in the embodiment, the 
same motion detection is performed to produce the first 
difference image, irrespective of the picture type of the input 
image. As described above, irrespective of the picture 
correspondence of the input image, the same motion vector 
detection is performed to produce the first difference image, 
wherebyvisualimportancecan be detected at a higher accuracy, 
and an improvement of the image quality of a reproduced image 
can be realized. 

(Embodiment 12) 

Hereinafter, Embodiment 12 of the invention will be 
described with reference to Fig. 13. The configuration is 
identical with that of Fig. 13, and the operation is identical 
with that of Embodiment 5. In the embodiment, irrespective 
of the picture type of the input image, the motion vector 
detecting section 902 performs motion vector detection in the 
unit of block on the input image with respect to a reference 
i^ge stored in a memory, and outputs a motion vector and a 
first difference image. Moreover, an activity in the original 
image state is compared with that in the difference image, 
it is determined which one of intraframe coding or interframe 
coding is to be performed on the block, and block type 
information indicative of information of the coding method 
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is output. The motion vector is input to the motion 
compensating section 906 . The block type information is input 
to the filter parameter calculating section 903 and the motion 
compensating section 906 . The first difference image is input 
to the filter parameter calculating section 903. 

The filter parameter calculating section 903 calculates 
a first activity in the unit of block from the input image, 
and a second activity in the unit of block from the first 
difference image. From the first activity and the second 
activity, and the block type information, thereafter, visual 
importance which indicates the degree of visual importance 
in the unit of block with respect to the input image is calculated 
For a block in which intraframe coding is selected, for example, 
its visual importance is set to be 1 . Further, from the visual 
importance, a filter parameter which is a parameter for 
controlling the degree of filtering in the unit of pixel with 
respect to the input image is calculated . The filter parameter 
is input to the filter coefficient determining section 904. 

The filter coefficient determining section 904 
determines a filter coefficient from the input filter parameter 
The filter coefficient is input to the filter calculating 
section 905. The filter calculating section 905 performs a 
filter calculation on the input image by using the input filter 
coefficient, to produce a filter image. The filter image is 
input to the motion compensating section 906. When the picture 
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type of the input filter image is a P- P icture or a B-picture, 
the motion compensating section 906 produces a predictive image 
from the input motion vector, the reference image stored in 
the memory, and the block type information, calculates the 
difference between the predictive image and the filter image, 
and outputs a second difference image . The second difference 
image is input to the coding section 907. When the picture 
type of the input filter image is an I-picture, the filter 
image is deemed as a second difference signal, and input to 
the coding section 907 . The coding section 907 codes the input 
second difference image, and outputs a coded data. The coded 
data is input to the local decoder 9 0 8 and the outputting section 
909. 

As described above, visual importance of the input image 
is calculated from the input image and the difference image, 
and a filter process is performed on a region of lower visual 
importance, thereby reducing the information amount. As a 
result, a larger code amount can be allocated to a region of 
higher visual importance, and improvement of the image quality 
can be realized. 

The means constituting the video signal coding apparatus 
of each of above-described Embodiments 5 to 12 maybe configured 
as hardware, or may be replaced with software having the same 
functions as corresponding ones of the above-mentioned 
hardware . 
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Industrial Applicability 

As apparent from the above description, the invention 
can provide a video signal coding method which codes a bit 
stream before transformation so that the code amount of the 
transformed bit stream can be set within a predetermined code 
amount, and also an apparatus for the same. 
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